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Let {Zn} be a real nonstationary stochastic process such that 
i?(Z„|J>,_i) < CO and E{Z^\Tn-i) < oo, where {Tn} is an increas- 
ing sequence of cr-algebras. Assuming that E{Zn\Tn-i) — gn(&o, fo) = 
gn\9o) + gi?''{eo,uo), 60 £W,p< 00, 1^0 G and q<oo,we study 
the asymptotic properties of 6„ argmin^ '^2=i(^>'- ~ 9k{(^,'^))^ ' 
where is J^fc_i-measurable, 1/ = {vk} is a sequence of estimations 
of uo, g„{9,i') is Lipschitz in 9 and gn\9o,9) — gn\9,u) is asymp- 
totically negligible relative to g^\9o) — g^\9). We first generalize to 
this nonlinear stochastic model the necessary and sufficient condition 
obtained for the strong consistency of {9n\ in the linear model. For 
that, we prove a strong law of large numbers for a class of submartin- 
gales. Again using this strong law, we derive the general conditions 
leading to the asymptotic distribution of On- We illustrate the the- 
oretical results with examples of branching processes, and extension 
to quasi-likelihood estimators is also considered. 



1. Introduction. Let {Zn}nen be an observed one-dimensional real stochas- 
tic process defined on a probability space (O, J^, P^g^iyg) dependent on a un- 
known parameter (6*0, uq), 6*0 G 6 C M^, < j5 < oo, uq £ M , < g < oo, 
and assumed to satisfy 



Mz: Vn Ee,^,,{Zn\Fn^i) = gn{Oo, ^^o) = g^nK^o) + gl:>{eo, uo), 
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where {J-^n} is an increasing sequence of cr-algebras depending only on ob- 
served processes, is a unknown parameter that we want to estimate, is 

(2) 

a nuisance parameter defined, when q = oo, by uq = {uQn} with gn {9q,vq) = 
gn\Go,von), 9n\do) is the J>i_i-measurable parametric part of the model 

(2) 

that may be nonlinear in 9q, and gn {0o,i^o) is J-n-i-measurable and such 
that gn^ {00, ^o) — 9n^ {0, ^^o) is asymptotically negligible relative to gn^ (Oq) — 
9n\o) (definition given in Section 4). The simplest example of asymptotic 

(2) 

negligibility is when gii {Oq.,vq) is independent of ^o- The case g = is de- 
fined by gn (Sq, J^o) = 0, for all n, and corresponds to the classical parametric 
setting. 

Examples of models Mz are nonlinear regression models with random 
covariates and heteroscedastic variances, stochastic dynamical models in 
discrete time, nonlinear time series model (TARMA, SETAR, bilinear pro- 
cesses), financial models (ARCH, GARCH and others) and branching pro- 
cesses, provided that the first two conditional moments at each n of all of 
these processes are finite. This means, in particular, that processes with a 
heavy-tailed distribution (see [10] for such an example) do not belong to this 

class. However, a solution when EQ^^y^^{Zn\J^n-i) < co with (T^(0o,z^o) *= 
oo, where a^(6'o,fo) := E0^^y^^{[Zn - E0^^y^{Zn\Tn-i)f\^n-i), could be to 
deal with the truncated process Zn '■= Znl\^z„ei„}, where lim„/„ ^= M since 
by defining rjn := Zn - Ee^^^^{Zn\J^n~i) and 5n(6'o,z^o) := Eg^^^^^{Zn\Tn-i)-, 
we can then define ^o) = -E'6»o,i^o(^nl-^n-i) ^'^'^ 9n\Go,^o) = -Eqo^vo x 

(^nl{Z„^7„}|-^n-l)- 

We consider the class of weighted CLSE (conditional least squares esti- 
mators) of Oq in the approximate model {gk{Go-,i^)}k<n-, where d = Vn 
being any estimation of vq based on observations up to n. We will consider 
two different settings: 

Al: Vn 9n{0 = gn{0 ^Vn) or gn{0 = gn{0 ,Vno); 

k2:Mn,Mk<n 9k{0,i') = gkid,^n)- 
Such an estimator is defined by 

n 

(1.1) ^„:=argminS„|p(^), Sn\u{e) ■.= y^{Zk - gk{9,u)f 

where Xk is an J^fe_i-measurable variable independent of (^Oj^^o)- When 
9k{(^i^) has a first derivative g'f^{9,'P) in 9, (1.1) implies that 9n is an es- 
timating equations estimator (EEE), that is, 

(1.2) Qniv(9n]{Zk,ak{9)})=0P''\ {afc(0)J-fc_i-measurable}, 
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n 

(1.3) Ctr.\^{e- {Zfc, afc(^)}) : = - ^(Z^ - gfc(^,P))afc(0), 

fc=i 

where, here, afc(0) = gJ,(0,z?)A^^ for all A;. 

In the classical parametric setting (7 = 0, the weighted CLSE's and, more 
generally, the EEE's, are well studied and are known to have interesting 
properties. These estimators are robust to the form of distribution of the 
respective residuals {Z„ — gn{do-,^o)} since they require at most the knowl- 
edge of the first two conditional moments of the process at each time n and 
their computation may be achieved, even in the case of complex or unknown 
likelihoods. When a'^{9Q,VQ) is an explicit function of (^07^^0)5 such an es- 
timator may be used to derive the empirical distribution of the estimated 
residuals {[Zk — gk{Sn,i')]['yk{dn,^)]~^} , thereby allowing a re-estimation of 
^0 by a maximum likelihood estimator (MLE) when the theoretical distri- 
bution may be modeled by a function of 6q, provided that the estimator 
is close enough to 6q and is therefore strongly consistent [26]. In the par- 
ticular setting a'^{9Q,i'Q) = a'^{6o,i'o)Xn, where A„ is -measurable and 
independent of (^O)'^o)) the optimal CLSE of 6*0, from the point-of-view of 
the asymptotic variance, is obtained by making the errors of the model sta- 
tionary, that is, by minimizing Yl]^=ii^k — gk{Gii^o)Y^k^ ■, and is equal to 
the optimal EEE, called the quasi-likelihood estimator (QLE) (see [15] for 
the optimality of the convergence rate in the branching process setting and 
[7] for the QLE). In the general case, if gn{Q,i-'o) has a first derivative in 9, 
then a possible estimator is obtained by replacing a1{9Q,UQ) by a\{9,v) in 

Q.„|p(6l;{Zfccr^^(6lo,fo),gfc(^'^)^fc^(^o,'^o)})- When g = 0, the obtained esti- 
mator is the QLE. This estimator is optimal from its asymptotic variance 
point-of-view within the class of estimators which solve (1.2) and (1.3), [7], 
and is moreover equal to the maximum likelihood estimator (MLE) when 
the conditional distribution of belongs to an exponential family at each 
n [32]. Another possible estimator is the weighted CLSE defined by (1.1), 
where {A^} is a sequence of 7"fc_i -measurable estimators of {17^(^0) ^^o)} up 
to a multiplicative constant. Since 

mm < — _„ < max , 

k<n Afc J2k=li^k- gk{0,'^)r(^k i^O^'^o) ^^"^ 

if {An} is such that 

(1.4) <■ lima2(0o, z^o)A~^ < ]h^a'^{9o, iyo)K^ <' 00, 

n " 

then the asymptotic behavior of ^^=i{Zk — gk{9,i'))'^X'f^^ , and therefore 
of its argmin, should be close to that of ^^=i{Zk — 5'fc(^)^^))^<7fc ^(^O) ^^o) 
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and of its argmin. Finally, if Fn-i denotes the set of -Fn^i-measurable vari- 
ables, since EQQ y^{Z n\Fn-i) is the best predictor of Z,„ based on Fn-i in the 
least squares sense because EQ^^^y^{Zn\Fn-l) = argmin^^^ ^ EQ^^^g{{Zn — 
g)'^ \~^\J^n-i), provided that A„ is an -measurable variable indepen- 
dent of 5 [9], a weighted CLSE should easily be strongly consistent. Since 
we are particularly interested in such a property, which is necessary when 
accurate knowledge of the true parameter is required, we will focus here on 
the asymptotic properties (strong consistency, asymptotic distribution), as 
n— )■ oo, of the weighted CLSE solution of (1.1) in the general setting Mz 
with the weakest possible assumptions on the process behavior, condition- 
ally on {9}. However, the results could easily be generalized to the QLE 
when a primitive of the estimating functions exists (see Section 9). 

From now on, to simplify notation when studying {On} which solve (1.1), 

— 1/2 

we will use the normalized process Yn ■= ZnXn and denote by My the as- 
sumptions concerning {Yn} when {Zn} verifies Mz- More precisely, defining 
fn\Oo) := gi^\9o)Xn^^'^ and fn\Oo,iJo) := g^\do,uo)Xn^^'^ , we have 

My: Vn Ee,,,,{Yn\J^n-i) = fn{Oo,uo) = £\eo) + fi^\eo,uo), 

Eeo,uo{Yn\J^n^l) < OO 

and rjn := Yn — Egg^^g{Yn\Tn-i) is a martingale difference. Equations (1.1) 
and (1.4) are now written, respectively, 

n 

(1.5) On = argmin 5,|p(e), 5,,p(0) := V(yfc - fk{e,D)f, 

(1.6) 0<lim(7„ < limc7„ < oo, a„ := Eirj \J^n-i)- 

Among published works on the estimator consistency in My, only the case 
g = is considered and two large classes of proofs exist. One class is based 
on the stationarity and ergodicity assumptions of the process [26], on the 
strongest assumption of independence of the errors (classical regression) or 
on the explicit expression of the estimator according to the process together 
with the knowledge of its asymptotic behavior. It is, in particular, the case 
of a branching process when the corresponding model is linear in [8, 
35]. The other approach is based on the (much more general) martingale 
difference property of {rjn}- Here, we are interested in this second class, 
which is particularly useful for processes. When dealing with the parametric 
linear model fn{Go) = where W„ is either a deterministic vector and 

{r/n} are i.i.d. [20] or W„ is stochastic with p = l [21], then lim„ On '= if 
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and only if 

(1.7) limA,,i„|^WfcW^| =-oo, 

Amin{X]fc=i ^fc^fc"} being the smallest eigenvalue of Ylk=i^k^'k- Defin- 
ing 

n 

(1.8) Dn{9):=J2[dkm^ dk{e):=M9o)-fk{9), 

k=l 

(1.7) is equivalent to lim„Z)„(0) ^= oo for all 6 ^ 9q. This quantity is the 
identifiability criterion of Oq in the model. It is interesting to observe that 
{9n} cannot be consistent, or even weakly consistent, on the set {lim„ Dn{9) < 
oo}. 

However, in the general nonlinear stochastic setting My with q = 0, un- 
der some Lipschitz property of the model, all published theorems of con- 
sistency require, besides the condition lim^o"^ < oo and a condition of the 
type liuin Dn{9n) oo for some sequence {On} S \ &o (depending on the 
author), additional conditions concerning some rate of convergence to oo 
of {Dn{-)}- Moreover, these conditions differ from one author to another 
([1, 16, 18, 21-23, 31, 33, 36]; see [31] or [14] for some examples of models 
that do not verify these additional conditions). 

Here, we generalize the necessary and sufficient condition (1.7) to our 
general nonstationary nonlinear stochastic model My with < g < oo. When 
q = 0, we prove the strong consistency of {9n} on the set 

(1.9) LlFeiifkm) n Sle{{Dn{9)}) n YARe{{aldk{9),Dk{9)}), 
where, in the following, "V5 > 0" means "V(5 > small enough" and 

• LIP5i({/fc(0)}) is the set of trajectories satisfying the following Lipschitz 
condition: for all k, there exists a nonnegative J^j^i-measurable function 
gk and a function h{-) ■.M'^ — )■ M"*" with \[mx\oh{x) = such that for all 

9i G G,02 G e, \fk{9i) - fk{92)\ <■ h{\\9i-92\\)gk, where || • || is any norm 
in W; 

5) is the set 



VARg{{al, dk{9) , Dk{9)}) that generalizes lim^o"^ < oo (proved in Section 



oo 

a.s. 



(1.10) {y6>0, sup Y.''k[dk{9)]^[Dk{9)]-^^< oo 
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• SIg{{Dn{9)}) concerns the identifiability condition generalizing (1.7): 

V(5 > inf L',j(6') is J>i_i-measurable, 

||6»-0o||>5 



lim inf Dn(9) ='oo. 

n [|6I-6Iq||><5 

The same terms LIP5i(-), VAR£)(-), Slg{-) wih indicate both the set of tra- 
jectories and the corresponding conditions verified by these sets. The result 
is then generalized to the setting < g < oo, replacing, in each condition of 
(1.9), fk{d) by f^\9). This consistency result is due to an original SLLNSM 
(strong law of large numbers for submartingales). In addition, we show that 
the asymptotic distribution of the CLSE is easily derived from a classi- 
cal CLT (central limit theorem), thanks to this SLLNSM. Therefore, this 
SLLNSM is the key result of this work. 

The paper is organized in the following way. In Section 2, we give some 
examples of processes {Zn} satisfying Mz- We deal with the consistency of 
{On} in Section 3 when g = 0, and in Section 4 in the more general setting 
< (7 < oo. This result is obtained thanks to an SLLNSM that is proved in 
Section 5 using submartingale properties [9], analytical lemmas and Wu's 
lemma concerning the consistency of estimators minimizing a contrast [34]. 

The consistency result obtained in the general setting < q' < oo shows 
the robustness of this property with respect to the chosen model since, if 
{On} is strongly consistent in a given model, then it is strongly consistent 
in every model "close," from the identifiability point-of-view, to this given 
model. 

In Section 6, we give general conditions for obtaining the asymptotic dis- 
tribution of {On} from the classical CLT for martingales or for random sums. 
As in the classical nonlinear deterministic regression model [34] , the proof is 
based on the Taylor series expansion of dSn\u{0)/dO, where the convergence 
to of the remaining term of the Taylor series is a direct consequence of the 
SLLNSM. 

In Section 7, we estimate the part of uq involved in the asymptotic dis- 
tribution of {On} and give conditions for its consistency. 

In Section 8, we give some examples in the single-type branching processes 
field. These processes model population dynamics. The population size Nn 
at n is defined by Nn = Xn,i, where the offspring sizes {Xn,i}i, given 

are i.i.d. with mean mg^^^iyg{Fn-i) and variance ag^^^^{Fn-i), -F„_i 
denoting the set of random variables involved in J-n-i, and J-'n-i being 
generated by {iVfc}fc<„_i and possibly environmental processes until n. Es- 
timation in this field is well understood in the framework of a BGW (Bi- 
enayme-Galton-Watson) process m0^^^g{Fn-i) = mo, (Tg^ ^^{Fn-i) = ctq or a 
derived process (BGW with immigration, controlled branching processes). 
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assuming a linear model in Oq, and are predominantly based on the observa- 
tion of the size Nn of the population at each time n. The estimators are most 
often moment estimators, MLE, CLSE, QLE. The asymptotic properties as 
n — )■ oo are derived on the nonextinction set from the explicit expression 
for the estimator according to {Nn} using the asymptotic behavior of the 
process, when suitably normalized. An overview of the references may be 
found in [8, 35], or in [25] for additional references for multitype processes. 

Much more difficult is the study in the nonlinear case when there is 
no explicit expression for the estimators. The MLE is generally not eas- 
ily computed because of large combinatorial terms. However, if we write 

y„ := iVniV-_'f = m,„,,„(F„_i)7V^^\ + 7?„, where Vn = iV~_'(' E^IT' i^n,^ - 
mep^i/(,(Fn_i)), then T]n is approximately normally distributed on the nonex- 
tinction set as soon as n is large enough. Consequently, the CLSE with {A„} 
satisfying (1.4) is approximately equal to the MLE on this set. 

Therefore, we began to study the CLSE of in size-dependent branching 
processes [15, 24] and in regenerative branching processes [16]. The results 
presented in this paper improve on, and generalize, these results. The first 
example is a supercritical single-type BGW process, where the offspring 
mean mo is estimated. We give the asymptotic properties of fhn- The re- 
sults are well known [3, 8], but the indirect form of proof given here for the 
consistency does not require accurate knowledge of the asymptotic behav- 
ior of the process, as is the case in the classical direct proof based on the 
analytical expression of the estimator. We then deal with some near-critical 
size-dependent branching processes which model the amplification process 
in the polymerase chain reaction setting [27]. In this setting, we prove the 
strong consistency and asymptotic distribution of the CLSE of the parame- 
ters of the replication probability for each model. The more complex model 
contains an explosive part tending to oo, a persistent bounded part and a 
transient part. In this model, despite these three different kinds of behavior, 
we prove the consistency and the asymptotic normality of the CLSE of a 
bidimensional parameter with components belonging to the persistent part 
and the transient one. 

Finally, in Section 9, we extend the consistency conditions to estimators 
solving (1.2), (1.3). 

In the following sections, we will simply write E{-) for ii^g,j^,y(j(-). 

2. Examples of models. Here, we give some examples of classical models 
satisfying Mz- 

2.1. Regression models. The observed variable Z„ is explained by a para- 
metric regression function gniOo) of a random (or deterministic) vector of 
observed covariates or coprocesses {X.k}k<n and the residuals {Z„ — gnido)} 
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are assumed independent with finite variances. The time regression model 
with d = l and X„ / = n is a simple example. 

The general class Mz allows the extension of these models to gn{(^o,'^o) 
and nonindependent residuals such as the following example: Zn = 5'n(^o) + 
e„_ie.„. Since we may write e„_i as a function of {{Z/^ ~ 9ki&o)}2Zi^^o}, this 
model belongs to the Mz class. 

2.2. Financial time series. The most well known of these are the ARCH 
model introduced by Engle [5] and the more general GARCH models. Let 

= SniOo)Un, where the {Un} are i.i.d. (0, 1), Sn{do) ^ 0, J^n-i is generated 
by {Cl}k<n-i and 5^(6*0) is .Fn-i -measurable with sl{6) = ao + I]j=i "iCn-i + 
Sj=i /3js'^__j{6). The process {sn{0o)} is called volatility. Then E{^'^\Tn-i) = 
SniOo) and follows a GARCH(p, g) model. If {^n} is observed, then Zn 
is defined in the following way: Zn = £,n = •5n(^o) + •Sn(^o)(f^n ~ 1)' implying 
that gni9o) = sliOo), an{9o,i^o) = sl{9o)[E{{Ul - 1)2| J-„„i)]V2. More gener- 
ally, {^n} may be nondirectly observed [14, 26]. 

2.3. Linear or nonlinear time series models that may depend on nonsta- 
tionary exogenous inputs {un}, such as ARM AX models. We define := 
Zn - 9n{do), where 5„(6') = Ylk=l^kZn-k + Yl=il^ken-k + Y!k=olkUn-k- 
Here, Tn-i is generated by {Zk}k<n-i-,{'^k}k<n- 

2.4. Single-type discrete-time branching processes. This class of models 
is described in Sections 1 and 8. 

2.5. Models with observation errors. In practice, the model may be Z*'^ = 
Q^ni^o) + en, Zn = Z^ + Un, where Zn is the observation of the theoretical 
unknown variable Z^^, Un is the observation error with a unknown distri- 
bution and g^ni^o) = -^(^r? 1-^-1 )• Then, assuming that E{un\J^n-i) = 0, 
we have gni^o^^o) = E{gl^{6o)\Tn~.i). For example, consider the BGW pro- 
cess {N^^} with Nn = + Un, f^{m) = m(7V*'i^) ^2. Then, using the first 
order Taylor series expansion, we get 

Um^,yQ):=E{C{e^)\Fn-i) 

= mE{[Nn-l-Un-lV'^\Fn-l) 

= mNlL\ + mO{E{ul^,\Tn^i)N-:^{'), 

where u = {mE{ul_^\Tn^i)}, {m,u) = mO{E{ul_^\J^n-i)N~^i^). The 

(2) ^ 

asymptotic negligibility of {/A (m,i/)} is obtained on the nonextinction set 
for any bounded sequence z? since lim„ A^^^i ^= 00 on this set. 
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2.6. Multivariate stochastic regression models. Estimation in this field 
may also be expressed as a finite fixed set of one-dimensional models be- 
longing to one of the previous types. Let us assume that G M'^ with 
E{Zin\J^n-i) = gn(^05i^o) ^-^d let S„ be a known J>i_i-measurable positive 
definite estimation of the conditional variance-covariance matrix of Z„ up to 
some unknown multiplicative constant. Then 9n = argmin^ge Sn^^{9), where 

n 

Sn\u{0) ■■= 5^(Z, - gfc(0,P))^S-l(Z,, - gfc(0,P)). 
k=l 

Since 5]^ is positive definite, we may write 5]^ = UfcAfcU^^, where is an 
orthogonal matrix and is the diagonal matrix of the eigenvalues of 5]^- 
Therefore, writing = A^^^^U^^Z/,, where = {Yk^i, . . ■ ,Yk,df , we get 

1/2 1 

gfc(^o,i^), Yfc - £;(Yfc|J"fc„i) is a martingale difference 

and 

d n 

(2.1) Sr^^m = E - hA(^^^)f- 

j=i k=i 

3. Consistency in My with q = 0. In this section, we generalize (1.7) 
to the setting of the model My under q = 0. So, we have d^^\6) = dk{9). Let 
us assume that Oq^Q, where is an open set and is compact. From now 
on (in all sections), let {7 € Bf\ := {7 : II7 — 7o|| > 5}, where 7 may be any 
subset of {9,v). 

Proposition 3.1. Let cVt he defined by 

noo = UPe{{fk{e)})nSlei{Dn{9)})nYARe{{aldk{9),Dkm)- 
Let us assume that P{i}oo) > 0. Then lim„ 9n ^= 9q on ^^o- 

Remark 3.1. In the linear model, fn{0) = ^'^W„ with lim„cj^ < 00, 

rJoo is reduced to {lim„ Amin{X]fc=i ^fc^fc } ^} thanks to Proposition 
5.2. 



Proof of Proposition 3.1. We use Wu's lemma ([34], see Lemma 
A.l) and Wu's decomposition based on — fk{9) = % + dkiO) [34], im- 
plying Sni9) - SniOo) = Dn{9) + 2L„(0), where Ln{9) = ELi%4(^) and, 
consequently. 



(3.1) 



inf Sn{9) 



Sn{ 



> inf Dn{9) 



1-2 sup \Ln{9)\[Dn{9)y 
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The proof then foUows directly from the SLLNSM (Proposition 5.1) apphed 
to dk{e) = UBo) - fk{0) and B = B^. □ 

Let us now assume that O^ n = argmineGe Yll^=h+i(^k ~ where h 

may depend on n (e.g., n — h\s constant for all n) and let Ln{9) — Lh(9) =: 
Lh,n{0) and Dn{e) - Dh{9) =: Dh^^). Let us define 

KKTe{Dn{e)[Dh^n{e)]-^}) := [m sup Dn{9)[Dh,M'^ <' ooj. 



Proposition 3.2. Lei l^oo C 57 6e defined by 

Qoo = LIPe({A(^)}) n Sle{{Dn{e)}) n YARe{{aldk{e),Dk{e)}) 
nRATe{{Dr,{e)[Dh,nm~^})- 
Let us assume that P{Qoo) > 0. Then l\mn6h,n = on Qoo- 

Proof. When h is fixed, we are in the setting of Proposition 3.1. There- 
fore, let us assume that /i — ?• cx) as n — ?■ oo. According to (3.1) written with 
Sh,n{9) instead of Sn{9), it is sufficient to prove that lim„supg Lh n{9)[Dh,n{9)]~^ = 
when lim^infegBj Dh,n{9) '= oo. For that, we use Proposition 5.1 with 

Let us now assume, as in the last item of Section 2, the multidimensional 
case Tin £ I^"^- The CLSE of 9q is then given by (2.1) and, more generally, by 

d n 

6l/,,„ = argminV' {Ykj - fk,j{0)f . 

Let Dh,n,M = El=h+i{fk,m - fkA^o)? and D^jid) := I?o,nj(^). 
Proposition 3.3. Let Q^c CVL he defined by 

= f]{UFe{{fk,jm) n Sle{{Dn,j{m 
j 

nVARe({4^-,4j(^),I)fcj(^)})nRATe({Z)„j(0)[Z)ft,„,,(0)]-i})}. 
Let us assume that P{^}oo) > 0. Then lim„ O^^n ^= on Oqo- 

The proof follows directly from Proposition 3.2 applied to each j = 1, . . . ,d. 
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4. Consistency in My containing a nuisance part. Let us now assume 
that {f!^\Oo,i'o)} is not identically null. We prove the consistency condi- 
tionally on a given sequence of estimations {i'}. 

As in Section 3, £ where Q is an open set and is compact, and, 
under A2, i/„ G A/", where J\f is compact. 

Let DUe,D) := Ek=i[dk{e,D)? , D^\e,D) := Ek=i[4\o,u)]^ 4\d, 
d) := f^^\eo,u^) - fi\6,d), Lt\e,d) ■.= El=iVk4\e,d), i = 1,2, and so 
on. 

Let us define the following asymptotic negligibility property under Al: 

ANei{S^\e,D),d^^\e)}y.y6>o 

-1 



lim 

n 



sup 



\d'^\e,d)\ inf 



a.s. 



0. 



Under A2, we define A^eA{dn\0,i^),d^n\e)}) in the same way, replacing 
by 1/ and sup^^g^j by supi^g^^^^Bi in A'Ng{{d'h\9,D),d'h\9)}). 

Proposition 4.1. Let Qoo C $7 6e defined under Al by 

= Lip,({/(^V)}) n Lip,({/f n sig{{Di^\e)}) 

nANo{{d^\e,D),d(^\e)})nYARg{{ald^j^\e),Dl}\9)}). 

Under A2, replace v hy v and \AVe{-), AN6)(-) hy LIP6),i,(-), A^e^y{-), re- 
spectively. Let us assume that P{Vl^) > 0. Then lim„0„ Oq on Qoo- 

Remark 4.1. If, for all k, 



sup 

91,02: fi'\e,)^fl'\e2) 



l(/f (^1,^?) - fl'\02,mfl'\ei) - fl'Ho2)]-'\ 



is J^fc_i-measurable, then LIP5i({/^^^(6',P)}) is satisfied under LIP0({/^"'^^(6')}). 

Proof of Proposition 4.1. We assume Al, implying that 
is independent of n and is therefore J-fc_i-measurable. As in the proof of 
Proposition 3.1, 

Sn\u{0) - 5„|i;(^o) = Dn{e,u) - Dl^\eo,9) + 2Ln{9,D) - 2L'^\9o,9). 

Since Dn{e,9) = D'^^\e) + Di?\9,D) + 2Y:i=id^k\^)dk\^^^)^ using 
Holder's inequality, we get 

inf Sr,\v{0) - Sn\t;iOo) 
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1/2 



(4.1) > inf D^^\e) 



1 — 2 sup 



sup 7-T 2 sup 



The result then fohows from Wu's lemma A.l, the fact that dk{9,u) — 
d^^\eo,d) = d^^\e) + d^^\e,V) - d^^\eQ,d) and Proposition 5.1. 

The proof under A2 is similar, replacing D hy v and supg(-) by supg ^{■) 
in (4.1). □ 

Of course, Propositions 3.2 and 3.3 can also be easily generalized to g > 0. 
5. Strong law of large numbers for submartingales. 

Proposition 5.1. Let QaW, compact, p<oo. Let {Tk} be an 
increasing sequence of a-algebras on Q and Ln{6) = X]fc=i G & Q, 

where, for all k, r]^ is any Tk-measurahle variable such that E{r]k\^k-i) = 
0, E{ri^\Fk-i) = fj^ < oo and dk{0) is any Fk^i-measurable variable. For 
all k, n, let d^:k{0) be Fk-i-measurable, D^n{9) = Yl'k=i'^^*ki^) ' Dn{0) = 
^11=1 '^fc(^)- C 6e defined by 

Qoo = LIPe({4(^)}) n UPg{{d,k{0)}) n Sle{{D,n{0)}) 

nYARe{{aldk{e),D,km), 
where LIP0(-), Sl6)(-) and VAR5i(-) are defined in Section 1. Let us assume 
that P{^oo) > 0. Then 

(5.1) limsup|L„(0)|[D*„(0)]~^ ='0 on^^. 



The proof is in the Appendix. 

Proposition 5.2. Let {r]k,dk{0),Dk{0)} be as in Proposition 5.1. Let 
us assume that for each 6 > 0, there exists a random k^^s G N such that 
km,5 = min{/c > 1 : [infeg^c dk{9)? > 0} exists. Then 

{li^ <■ oo } C VAR, {{aldk{d),Dk{e)}). 

Proof. Let us assume that lim„cr^ < oo. For each 9 and each trajec- 
tory, let us define f{x) := [dk{0)? for x £[{k — l),k[. Then 

4(g) iLmdx 
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< 



< 



f{x)dx 

2 ~| ^m,5 



< 



fo f{u) du 
1 



inf. 



□ 



6. Asymptotic distribution. This section is devoted to general conditions 
leading to an asymptotic distribution of given z/, where is solution 

of (1.5) in which either fn{Oo,i^o) = fn\do) + fn\Oo,'^o) or /„(0o,t'o) = 
fn\Oo,'^o)- This latter case is suitable when {6n,i^n} is strongly consistent, 
but the assumptions leading to the asymptotic distribution are fulfilled only 
with respect to (see examples in Section 8.2). 

We introduce the following notation [and similarly for fk{(^,v), k<n]: 



dS, 



n\u 



n\v\i 



where S^|-(0) [resp., S^|p(0)] is a p x 1 (resp., p x p) matrix. Let M„ = 
[Sfc=i^"fc(^0)^')ffc"^(^0)2^)]~^ (assumed to exist for all n sufficiently large) and 
let an G (0, 1), 6n = Oo + an{On — ^o)- Let us define, for g < oo, the following 
sets of trajectories: 



UNC({0„}): <^ lim 



ffc'^(^n,i 



.k=l 



M„ = I 



LIM({0„}): f|him„ 



n 

Y.(fk{Oo,yo) - fk{0n,'^0))fk;i,li0n,u)Mn[l,j 

I 

n 



k=l 



n < lim. 



k=l 



Remark 6.1. Note that UNC({0„}) may also be written as follows: for 
all (i,j). 
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^fc<n,fceNh(i,/) 

where Ni(«,/) = {A; : /^.j(6'o, z?)/^.;(6'o, z?) > 0}, and similarly for N2(i,0 with 
"<0" instead of ">0."' Therefore, UNC({6'„}) is verified on the set 

n{ i™« sup \fl.4en,mkA(^o,^T' - i\= o}. 

Proposition 6.1. Let us assume that fki^^v) has second derivatives in 
6 for each k ( and for u = u under Al and for each v under A2 ) and that 
there exists apxp J^n-i-measurable matrix such that P{i}oo) > 0, where 
CIqo is defined under Al by 

fioo = f]{LlFe{{f',:.,i,i(.0,D)}) n SI({(M„[/, 

nYARg{{alfl,^i{e,D),{Mk[l,j]r'})} 

nUNC({0„})nLiM({0„}) 

n |lim*„M„E(/fc(^o,z^o) - /fc(0o,^?))ffc(^o,^>) = o| 

n < lim^'„M„E^%ffc(^0)Z^) 3 in distribution >. 
I " k=l J 

Then, on r^oo; 

n 

(6.1) lim*„(^„ - Oo) = lim*„M„Vr?,4(eo,i?). 

n n ^— ' 

k=l 

Under A2, replace v by u in LIPg, VARg and replace these conditions by 
LlPg j^, VARe respectively. 

Remark 6.2. In the linear model fn{(^,i^) = O^V^n with lim^cr^ < oo, 
we have M„ = ^^^^i W^W^]"-^ and, if lim„ On = iloo is reduced to 

= I lim A„,in I E Wfc I =■ OO I 



n < lim 

n 



\k=l 

n 

E^fcWi^ 

.k=l 



-1/2 „ 



Tjk^k 3 in distribution > . 
fc=i J 
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Remark 6.3. A CLT for martingale arrays may be applied to the right- 
hand side of (6.1) given D only if f^(0O)^^) does not depend on n, which is 
the case mider Al. 

Proof of Proposition 6.1. We derive, as in classical regression, the 
asymptotic distribution of the estimator from the first order Taylor series 
expansion of S'^^-p.^{6n) at Oq for all i = 1, . . . ,p (see, e.g., [34]): 

(6.2) S'^^^.^S^) = 5;|p,(^o) + i2id{S'^\^.^^)/de,m,){en, - 9o,), 

where 9^ = 00 + a„(^„ - ^o), an G (0, 1). Since S'^^^..{en) = for ah i, (6.2) 
is written in matrix form, = S'^^^{6q) + S'^^^{6n){0n — ^o), implying that if 
5^|p(-) is invertible in a neighborhood of then 

(6.3) *„(^„ - 9o) = -*n[S::|p(0„)]-is;|p(0o) 
for any p x p matrix Moreover, by definition. 



(6.4) 



k=l 

n n 

k=l k=l 

n 

-2j](/fc(^o,i^o)-/fc(^,^^))ffc(^,i^)- 



Considering (6.4), if the conditions 
(6.5) lim 



(6.6) 
(6.7) 



lim 



fc=i 

n 

5;4(e„,P)ff(0„,?) 



.k=l 



lim 

n 



.k=l 



M„ = 0, 



M„ = I 



are fulfilled, then we get lim.„2 S"|p(^„)M„ = I. Therefore, writing 
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and using Slutsky's theorem, we get (6.1) on r^oo* 
Now, concerning (6.5), it is satisfied if, for all i,l, 

(6.8) sup lim sup 

i,i,j " e 

which is verified according to Proposition 5.1. Finally, (6.6) and (6.7) are 
verified on LlM{{9n}) n UNC({0n})- □ 



n 

k=l 



|M„[Z,i]| =-0, 



When UNC({0„}) is not verified, we may instead use the second or- 
der Taylor series expansion of S'^^^.-^On) at ^o- So, let [df'^.^j/d0i\{6,d) =: 

fk',i,jA^''^'> 

Proposition 6.2. Let us assume that fki^^T^) has third derivatives in 
for each k ( and for v = t) under Al and for v under A2 ) and that there 
exists a p X p Tn-i-measurahle matrix ^„ such that P{Qao) > 0, where fioo 
is defined under Al by 



o«,= fl LIPe({/I^,/0,P)})nSI({(M„[/,j])-i}) 

i,j,h,l,m K. 

nYARe{{alf'L,{e,^)),{Mk[l,j])-'})nLIM{{en}) 



n < lim 



:*„M„)[i,i]5^4^(0„,i?)/^^^/e„,p) 



k=l 



a.s. 

< OO 



nsi({((*Mj[;,j])-i}) 

nVAR,({a2,/- (0,l?),((*,Mfc)[i,i])-i}) 



n<^ lim (*„M„)[i,j] 



fk{do, ^o)fk',j,h,li^n, 



k=l 



a.s. 
< OO 



n 



lim*„M„^(A(0o,^^o)-/fc(^o,i>))ffc(eo,^?) = O 



k=l 



n ^ lim'I'„M„^^r7fcf^(^0)^^) 3 in distributions . 



k=l 



Then, on Vt^, lim„ *„(6'„ - ^o) = lim„ *„M„ X]fc=i %ffc(^o, J^)- 

Under A2, replace vbyvin LlPe(-), VAR5)(-) and replace these conditions 
by the corresponding conditions on 0,v. 
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Proof. Consider the second order Taylor series expansion of S'^^^.-{9n) 
at for all i = 1, . . . ,p, 



(6.9) 



+ lY.^d\s'^^^.^^)/{de,ddi)]{en)(en,i - 0o,/)(^n,, - eo,,), 



where 0„ = + o-niSn — Go), o-n G ]0, 1[. Using the definition of (6.9) may 
be written 



= S' 



1=1 



Let Si p X p matrix. Then 



I 



The proof is then similar to the proof of Proposition 6.1. To prove that 
lim.„ S^|-(0o)Mn = 21, we need the assumptions of Proposition 6.1, where 

{On] and 9 are replaced by ^o- Next, using the fact that lim„ S^|-(^o)M„ = 
2/, we show that 



lim*J[SV(0o)]-^ 



\Y.'^dK\u)ldmn){Ki-G^,i 



{On - eo) = 0. 



From (6.4), we deduce that 

1 ^s^i, 

k=l 



2 de, 



k=l 



k=l 



k=l 
n 



k=l 



The proof is then as in Proposition 6.1. □ 
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7. Estimation of uq. In the previous sections, we obtained conditions 
leading to the consistency and the asymptotic distribution of given {I'n}- 
When the asymptotic distribution of 0„ depends on uq, it is necessary to 
derive a consistent estimator of vq. Let us write uq = {i'q^\i'^^), where u^^^ 

(2) 

is of dimension Q'l < oo and Vq is of dimension (72 < oo, and such that the 
asymptotic distribution of 0„ is independent of z^q^"* and 

fn{do,i^o) = fn{Oo,i^o^), al{9o, i^q) = (6*0 , ) , 

where, now, a'^{9Q,v^^^) := E{[Yn — E(Yn\Tn~i)]'^\J^n~i)- Let us further as- 
sume that there exists s{6,i'^'^^), a continuous function in {9,u^'^^), such 

that lim^ \I'n(^n — ^o)[s(^0) ^^o^'')]"'^ = ^1 where C is independent of the un- 

known parameters. Then, for any sequence of estimators {{6n,i^n )} such 

^ ^(2) p (2') ^ 
that \\m.n{On,T^n ) = (^Oi )' thanks to Slutsky's theorem, lim„^.„(^„ — 

GQ)[s{6n,i'n^)]~^ = C, which allows for the elaboration of confidence regions 
of ^0- 

(2) . 

Therefore, we build here a CLSE of Vq and give the conditions for its 
consistency. Let us define 

= argmin S ,^ 

n 
k=l 

where n,„ = - A(?„, pW))^ = (% + 4(^n,i>(')))', 7fc,n(^o, ^) := E{Yk,n\ 
Fk-i) = aliOo^u'^^'^) + dlidn^^^). Let us define 

dkiOnW^^^) := Ik,ni^O,'^^^^)-fk,n(0n,'^^^^) := a,^ (^0, ^^^'^ ) " ^T,^ l.^^) ) ^ 

n n 

k=l k=l 

n 

Ln,n{^^^'^K) ■.= Y.m,ndk{l^^^^\0n), 
k=l 

rjk,n ■■= Yk,n - E{Yk,n\^k-l) = Vk + 2r]kdk(0nM^^) , 

where rjk := rjf, — o"| (^o ) ^^o^^ ) • This implies that 

(7.1) Z„,„(z.(2)|^„) = L„(z.(2)|^„) + 2L„(z/(2)|a„,l?(i)), 
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where 

n 

k=l 
n 

k=l 

Let al.= Ei?g\T,.i). 

Proposition 7.1. Let us assume that (^1(0, v'^^) is continuous in 6, that 
-^(ryll < oo for all k and that lim„ 0„ =' 9q. Let cO, be defined by 

Let us assume that P{Q,oo) > 0. Then liuinUn^ on ^^oo- 

Proof. Let us write 

Yk,n - Mn, ly^^^) = Vk,n + 4(^n|z^S'^) + 4(i^^'^|^n). 

Then, using Holder's inequahty, this decomposition leads to 

n n 

= E[^'«(^^'^l^")]' + 2^(^M + 4(^nkf ))4(z^(')|^n) 
k=l k=l 

>bn{v^^\en)-2\Lr,A^^^^0n)\-2[b^^^ 

which implies that 

inf S — 5 -fiiffn^^) 

> inf bn{u^^\dn) 

X "1-2 sup l^n,n(^(^^|g)| ^ - 

(M2))eB,^ Dniy'^^m inf,(2)g5.[Z)„(i/{2)|^„)]i/2_ ■ 

The result then follows from the assumptions of the proposition, from (7.1), 
from the SLLNSM applied to sup(g_^(2))gB|l^n(i^^^^|^)|[5n(i^^^^|^)]^^ and 
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to sup(e^,(2))^5.|L„(i/(2)|0,p(i))|[i)„(^{2)|^)]-i^ and from lim„|d2 (a„|z.J'))| x 
[infi.{2)gijc|(i| (z.(2)|^„)|]-il^.^^^^^^^^ j^(^(2)|e^)_^o} =' 0' ^^i^l^ deduced from 

the continuity of a"|(0,fQ^^) in and which, according to ToepHtz's lemma, 
leads to lim„5„(^,|z/f )[inf,(2)g5. 5„(z/(2)|a„)]-i "J' 0. □ 

8. Examples in branching processes. Here, we deal with single-type Mar- 
kovian branching processes in discrete time. The process {Nn} of population 
sizes at each time is defined by A^^^ = Yli=i^ X^^i, where the {Xn,i}i are 
i.i.d. given J^n-i that is generated by {Nk}k<n-i- In each example, the 

normalization is carried out in order to get lim.nE{r]^\J^n-i) < oo, implying 
that assumption VAR6i(-) of Proposition 5.1 is satisfied. 

8.1. BGW process. The {Xn,i}i are i.i.d. (mo,(TQ) and are independent 
of Tn-\- Then My is defined by 

Yn = NnKli^ , /„ (mo) = moNlL\ , r/„ = N-^{^ Yl (^"-^ " "^o) • 

1=1 

Therefore, E{r]'^\J^n-i) = Cq- Let = ""^o- Then fnifn) is Lipschitz in m 
with Qn = nI/^^ and inf^GS^ Dn{m) = inf^es^? (mo - m)^ Ylk=i ^k-i, which 
converges a.s. to oo, as n — )• oo, on the nonextinction set i^oo, where P{i}oo) > 
0, for niQ > 1. Therefore, assuming that niQ > 1 and using Proposition 3.1, 
we have lim„m„ =' mo on Qoo- 

Remark 8.1 (Direct proof). Recall that m„ is also the MLE estimator 
of mo [6] and the Harris estimator [11]: 

The strong consistency of {m„} on Q^o is then obtained classically (see [8]) 
by using Toeplitz's lemma with lim„ A^^^mp" ^= Wn^, where Wnq > on 
Qoo, E{Wj\fo) = ^0- Note that the indirect proof based on Proposition 3.1 
does not require knowledge of the asymptotic behavior of the process as is 
the case in this direct proof. 

In this model, (6.1) becomes 

J2 ^ {Xk,i-mo), 

k=l 1=1 



i.l) lim^'„(m„, — mo) = lim^*^ 



.k=l 
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which is also the expression obtained classicahy by directly using the expres- 
sion for m„. Since Efc=i[/fc("^o)]^ = ELi^fc-i =: ^n-i, Y.k=iVkf'k{mo) = 



En ■^Nk_i , Y 
k=l 2^1=1 



mo) 



mo), where the {Xj} correspond 



a.s. to the {Xki}ik, ordered according to i and then k. Setting ^„ 



mo) 



1) then becomes 

1/2 



E 

,A;=1 



m. 



,fc-l 





.k=l 




mo) 



which leads, thanks to Toeplitz's lemma on the first term of the right-hand 
side and a CLT for random sums [2] on the second term, to lim„ ^'„(m„ — 

TTT-o) = W^^U, where i7 ~ A^(0, cJq), U and VFtvq being independent. 

Similar results may be obtained for fhh^m where n — h is constant. In 
this case, "X]fc=i" niust be replaced by When h = n — 1, rhh^n = 

Nn/Nn-i is the Lotka-Nagaev estimator. 

Since mo = 1 is a threshold for the asymptotic behavior of {iV„}, if we do 
not know a priori whether m <1 or m > 1 , then we may estimate m using 
E{Nn\Nn-uNn + 0) instead of ^(iV„|iV„_i). 



8.2. Size- dependent branching processes. Nn = Yli=i ^ Xn,i with {Xn^i} 
i.i.d. {meoiNn-i),ai{Nn-i)), limNmg^iN) = mo, a^{N) = 6{Nl^°), where 
/3o is assumed to be known [19]. The model My is then 

n — ^V„iV^_^ — mgg[I\n-l)l\n-l + ^n- 

A particular example of a size-dependent branching process is the process 
modeling the amplification process in the polymerase chain reaction setting, 
taking into account the saturation phenomenon due to the closed medium 
[17, 30]. The ultimate goal of this technology is the estimation of A'o, the ini- 
tial number of DNA molecule fragments, through the amplified population 
in vitro. At each cycle of the amplification process, a DNA fragment may 
product two DNA fragments by replication after three successive steps — 
heating, annealing and synthesis. The amplification process exhibits three 
different phases: the exponential phase, during which the replication is not 
limited, then a saturation phase involving a "linear" phase, followed by a 
"plateau" phase where the replication is less and less efficient. Since the size 
of the population increases very quickly (exponential increase during the 
first cycles) and since the observation errors are very important during the 
first cycles but become more and more negligible relative to the signal as 
the number of cycles increases, the estimations should be based on the ob- 
servations starting only from the end of the exponential phase. The classical 
estimation method is based on a regression model using the observations at 
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the end of the exponential phase of a set of amphfication processes start- 
ing from successive dilutions of a given DNA sample and assumed to have 
the same replication probability. Besides the probable violation of the basic 
assumptions of this method (i.i.d. errors, identical replication probabilities, 
identical initial size up to the dilution factor, etc.), this method is costly 
since the accuracy of the estimator requires a large number of such trajecto- 
ries. Therefore, we developed conditional least squares estimation based on 
a single amplification process (or two if the "observation unit to number of 
molecules" conversion is required) [13, 24, 27]. Moreover, because of a very 
large population after only a few cycles, the asymptotic properties are ob- 
tained from the end of the exponential phase, leading to a great accuracy of 
the estimator of the replication probability, which is crucial for the accuracy 
of the estimation of Nq. We focus here on the estimation of the replication 
probability based on different models. 

The amplification process may be modeled by a simple branching process 
^n = ^^={^ Xn,i, where the {Xn,i} are i.i.d. given with P{Xn,i = 

l|-^n-l) = 1 Pm Pn '■ — -P(^n,i — 2| n— i) being the probability of replication 
at the nth cycle. When restricting the modeling to the exponential phase, 
we may assume that the {Xn,i} are i.i.d. (tticiTq), where mo = 1 +po, po = 
Pn and (Tq =Po(1 —^0)1 that is, the process is a BGW branching process 
([13, 27], see previous item). 

We now take into account the saturation phase. Therefore, the probability 
of replication is a decreasing function of the current size of the population. 
For example, Schnell and Mendoza [30] proposed the following enzymological 
model: 

Ml: Pn = [Ko]{[Ko] + [A^„-i])-^ = Ko{Ko + iV„_i)"S 

where [Kq] is the Michaelis-Menten constant, [A'^n-i] is the concentration 
of molecules at time n — 1 and Kq = [Kq] x V, where V is the volume of 
the reaction. Then {Nn} is a near-critical process with an a.s. nonextinction 
and lim„ Nnn~^ ^= Kq [17]. 

This model may be generalized in order to take into account a saturation 
threshold Sq > Nq. For example, in [24], 

M2-V i^o [l + exp(-Co(5o-^jV5„„,i-l))] 

KQ + Ns,,n-l 2 

where A^So,n-i = ^"0 if A''„_i < 5*0, and iV^cn-i = Nn^i if iV„-i > 5*0. When 
Co = 0, So = iVo, M2 is reduced to Ml. Since M2 is a BGW process for all n 
such that Nn-i < Sq, it follows that when Sq — )• 00, M2 tends to a BGW pro- 
cess. In the general case Cq^O with 5o < 00, we have lim„ Nnn~^ = Kq/2. 

a.s. 

When setting 9 = [K,C,S), we have lim.„ infg L'.„(0) < 00 and Kq is the 
only parameter verifying lim„ inf/^ L'„(J^) ^= 00. The asymptotic properties 
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of the CLSE of Kq^ assuming (Co, So) =: i^Oi ™ay be found in [24]. They can 
also be derived in the same way as for the following model using the general 
results developed here. 

Let us now assume another generalization of the Schnell-Mendoza model: 

As for M2, the limit of this model, as Sq — )• oo, is reduced to the BGW model 
and when ao = with 5o = A'^o, the model is reduced to Ml. Let us assume 
here that 5*0 < oo and < ckq < oo. As in [17] and [24], the asymptotic 
behavior of the process is linear: lim„ A„n~^ Kq/2 and the stochastic 
regression model is y„ = A„ = fn{Oo, ^^o) + ^n, where 



fn{do, I'd) 



1 + 



^0 + A^So 



n-1 



■"0 ^'So,n~lJ 



A, 



n— 1 , 



N„-i 

i.2) rin = iXn,^ " ^( A„,i | A^„_i )) , 



i=l 

2 



< = A„„ip„(l-p„) = 0(l). 

Let 6 = {K,S'^,a), q = 0. Using the first order Taylor series development, 
we have 



n 



mf DJe)= inf O V (A;-"o - /fc" 

6»6-B« \a-ao\>5 * ^ 



a\2 



\k=l 



= 0L inf V[ln(fc)]2A;-2S , a,,,G]0,l[, 

yo=oo+ai,Q (a-ao ) J 

which converges a.s. to oo for < 25 < 1. Therefore, if we assume that 
ao g]0,1/2[, then lim„(Ar„, 5^, a„) =' {Kq, Sq° ,ao)- Next, since the second 
derivative of /n(^) in ct increases to oo with n more quickly than its first 
derivative, assumptions such that V ARq {{a^, f'f!.^ 2(^1^)1 (Mfc[2, 1])""*^}) can- 
not be verified. Therefore, we restrict the study of the asymptotic distribu- 
tion to Kn and then to {Kn,Sn)- 

So, let us first assume that ^o = ATq and (Sg'^ao) =: 1^0 are nuisance pa- 
rameters estimated by {S^^,ano)- We have, for Afc„i large enough, 

= " (i^o + ALi)^ ^^ + " ^ = 
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Let us define 

n ^ n 

k=l k=l 

Then, thanks to Toephtz's lemma, hm„<I>~^^„ ^= 1 and ^„ = 0(1). Con- 
sequently, for < 2a.no < li the assumptions of Proposition 6.1, except the 
last one, which we consider now, are verified. By the definition of 

-1 

(8.3) % ~ 
Moreover, 



.k=l 



k=l k=l 



hm f^(iro,i?) =-1/2, limi?(??2|j-^_,)^^-Ko/2. 

k<n,k—>oo k 



Therefore, we may derive the asymptotic distribution of the right-hand side 
of (8.3) by a classical CLT for martingale arrays ([4, 29]: "let {M^"'^}fc<„ be 
a multidimensional martingale triangular array Yl'i=i^l,m E{^l,n\^i-\) '= 0. 
Let us assume (a) lim„(M)^"^ = T, where F is a semi-definite 
deterministic matrix and (M)^"'' := Yl?=i ^i^l,n^Tn\-^l-i)'^ (^) e > 0, 

limnELi^(llefe,nfl||a.,nll>el-^S) = 0. Then lim„ M^T^ ^ AA(0, L).") So, 
let us define the martingale array m[."^ = ^n^Yl^=iVifi{Ko:i^)- Then 



(M)(")=$-2^^(r?i|J-,_i)[/^(iro,i 
k=i 

which implies that lim.„(M)i"''' lim„ ii^(?/^| J>i_i) = Kq/2. Moreover, for 7i 
large, using Holder's and Markov's inequalities, we have 

n n 

^E{\\ik,n\?'M\s.k,-a\\><^\^k~i) < ^;;;^^£^(r/fci{^2>,2$2}|j'fc_i) 

k=l 

n 



k=l k=l 

n 



k=l 

o4| 



Using (8.2), we get E{ri'^\Tk_i) = 0(1) and ak = 0(1), which implies the 
Lindeberg condition since = 0(n). Consequently, lim„, $„(i^„ — Kq) = 
M{0,Ko/2) or, equivalents, lim„ V^l-^n - ^o)(2i^o)"^/^ = AA(0, 1). Note 
that if ao = (the Schnell-Mendoza model), then, in the same way, lim„ y/niyKn - 
Ko)i^o^'/'=AA(0,l). 
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We may also derive the asymptotic distribution using the CLT for random 
sums [28] apphed to the right-hand side of (8.3) using (8.2). According to 
this CLT, the asymptotic behavior is obtained, even for small n, because of 
the expression of rjk as the sum of a large number of centered variables. The 
asymptotic distribution of the estimator allows for the derivation of accurate 
confidence intervals of Kq. 

Let us now assume that 9 = {K, S*"" ) with ao = fo estimated by q^^ . We 
have, for k <n, 

4i(0,P) = Ni_,{K + Nk-i)-Hl + 5"°iV,-„7°)2-i = Oil), 
42(0,P) = KAr,,_i(ir + A^fc„i)-iiV;_";°2-i=O(A.-""o), 



fe-1 ^ 



/I^2,i(^,^) = 0(A:-""o). 



Kn 



n 

l—a. 



Kn 

K'^anittno) 



Therefore, UNC({6'ri}) is checked and 

n 

45^f^(0,P)ff(0,P) = O 

k=l 

where a„(a„(,) = n^-^^^o l^2a„(,<i} + lii'^l{2a„o=i}, implying that 



^O(n-i) O(n-""o[a„(a„j]-i) 
O(n-""o K(q„J]-1) 0(K(S„„)]-i) 

Consequently, all of the assumptions of Proposition 6.1 are satisfied for {0 < 
2S„o < 1}. Let us define = ^nMELi ffc(^o,^^)ff (^o,^?)], where 



n 



Kqu 



Therefore, 



^f^(^o,^>)/f(eo,i?) 



.k=l 



Y,rikru{Oo) = ^n^Y.'^kK{Oo,y). 



k=l 



k=l 



Then, using the CLT for martingale arrays ([4, 29]), we have 



lim*„(0„„-^o)=AA(O, (Ko/2)I 



lim$„(a„o-eo)=AA(0,(Ko/2)I). 



26 



C. JACOB 



9. Extension to estimating functions. To simplify notation, we assume 
that q = 0. Let Q„(6'; {Z^., afc(6')}) be defined as in (1.3), where 3Lk{G) '■= 
Ski9)[h{0)]~^ , bk{0) being J"fc_i-measurable. Let 6n solve Qn{0;{Zk,aik{0)}) = 
0. The CLSE solution of (1.1) corresponds to bk{6) = Xk and the QLE to 

bkie) = a-\e). 

Following [12], let 



(9.1) Sni9) :-- 



Qn-i{u;{Zk,akiO)})dui 



(0), 



,n. 



when this quantity exists. Since J Qn-i{u; {Zk, ak{0)}) dui]{9) = — Ylk=ili^k- 
9k{G))gk ii9)[bk{9)]~^ , it follows that when bk{0) is a function oi gk{0), Sn{9) 
exists (but does not necessarily have an explicit form). 

Let ek{e) := Zk - gk{e), d^(0) := gkiO^) - QkiO), Da,n{e) := ELi <kiO), 
where, for i = 1, . . . ,p, 



dl{u)gli{u)b^^{u)dui 



dl{u)g'kAu)bf^^{u)dui 



(0) 



and let 4,^(0) = [J g'k.Au)b~Hu) du,]{9o) - [J g'k.iiu)b~\u) du,]i9) , for i = 
1, . . . ,p, when these quantities exist. 

Proposition 9.1. Let us assume that Sn{9), defined as in (9.1) , exists 
and let Vt^ cO, be defined by 

= {UFe{{da,km) n UPe{{db,km) n Sh{{Da,n{e)}) 

n VARe({ai(0o, i^o),db,k{e), Da,k{9)})}. 

Let us assume that P(J7oo) > 0. Then lim„ 6n on floo- 

The proof is the same as in Section 3, where Sn{9) — Sni9o) = Yl^=i da,k + 
X]fc=i ^kdb,k{9)- In the particular case bk{9) = A^, we have da^k = 2~^[d^(^)]^A^"^, 
db,k{9) = d^f^{9)\^^ and Da,n{9) = Dn{9) up to additive constants, where 
Dn{9) is given by (1.8). Ooo is then reduced to the subset defined in Propo- 
sition 3.1. 

In the general case where bk{9) depends on 6, since conditions given in 
Proposition 9.1 may be difficult or even impossible to verify in practice, 
we may derive sufficient conditions using Wu's lemma applied to a Taylor 
series expansion of 5„(0) — Sn{9o). Writing ek{9o) =: e^, 0a = + ci{9 — 9o), 
a G (0, 1), we have 

Ck{9) := {9 - 9ofE'j,ieo)b^\9o) + Ca,k{9), 

Cam ■■= - 9^)'^[^l,{9a)bl\9a) - ^k{9a)[K{9a)Vbf{9a)]{9 - 9o), 

da,m ■.= {9-9ofg'k{9a), 
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DaAG) ■■= T^^daAO)? = {0- Oof^gMlg'Mfie - Oo). 



k=l 



k=l 



Proposition 9.2. Let us assume that Sn{0) defined as in (9.1) exists 
and that gn{G) has second derivatives in 9. Let VLao C O 6e defined by 

= UPe{{ca,k{0)}) n n LIPe(K;.(^)}) 

i 

n Sle{{Da,n{e)}) n YARe{{al{9o,i^o), Okie), DaMO)}) 



n < limsup 



.k=l 



Let us assume that P(f]oo) > 0. Then lim„0„ 6o on ^oo- 

In the particular class = Afc, we have VAR6i(-) = VAR0({(t|,(0 — 

0o)^ffc(e),I?a,fcW})=VARe({a2, 4(0), where 4(0), are given 

by (1.8). Consequently, f^oo (Proposition 9.2) C J^oo (Proposition 3.1). In 
the linear case with bk{0) = A^, we have that Q^o is reduced to (1.7) in both 
propositions. 

Proof of Proposition 9.2. Let us write Sn{0) - 5„(6'o) = {0- O^f x 
S'M + {6- eofS'^{ea)ie - 9o). Then 

Sn{0) — Sn{0o) 

n 
k=l 

n 

-{0- e^fY.^k[g:i{OaK\ea) - g:k{Oa)[h'k{ea)fhf{eaW - Oo) 

k=l 
n 

-{0- 0ofY.<{eaM{eaK'{9a) - S'k{0aM{9a)fbf{9a)] 
k=l 

x{9- 9o) 

and then the proof is as in Section 3. □ 



We will not describe here the asymptotic distribution for these estimators 
since the methodology is the same as for the CLSE. 
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APPENDIX 

Proof of Proposition 5.1. We work on \ARg{{al,dk{6),D^k{9)}). 
Let us assume that is a finite set (i.e., Q = {9i}i<i)- Therefore, there exist 
some random integers inl^I and j„ < / such that supg^g |L„(6')| [L'*„(6')]~^ 

\Ln{Oi^)\[D^.n{Oi^yr^ , mfg^^D^niO)''= D^niOjJ- Moreover, thanks to the 
SLLNM (strong law of large numbers for martingales. Theorem 2.18, [9]), 
we have 

V^ee lim|L„(0)|[Z)*„(0)]~^ ='0 on |limD*„(0) =-oo|, 

which implies that lim„ \Lni9iJ\[D^ni0i„)]'^ =' on f|j</{hm„ D*„(0j) =' 
oo}, which contains {lim„ L'^,„(0j^) ^= oo}. 

Let us now assume the general case C M-p. The general idea for proving 
the result is then to extend the proof concerning the case where is finite: 
for each n, we will use some random J>^_i-measurable discretization 0„ of 
that becomes finer and finer as n ^oo, together with the fact that, for 
each k <n, there will exist a point of 0^ which will get closer and closer to 
6 as k increases. So, writing 

(A.l) hmsup <limsup — — + limsup— — — — , 

where Gni^) ■= {9k{d)}k<n, dk{d) G ©fc being one vertex of 0^ among those 
closest to 9, and 



n 



Ln{9,Gn{9)) ■.= Y,Vkidk{9) - dk{9k{9))), L„(g„(0)) := 5^??fc4(efc(^)), 

fc=l k=l 

it will be sufficient to prove that each of the terms of the sum of the right- 
hand side of (A.l) is null. For the second term, we will use the fact that 
the set {{9k{9)}k<n}e is finite, together with the usual SLLNM (strong law 
of large numbers for martingales), LIP0({(i,,fc(^)}) and the sufficiently rapid 
convergence to of the mesh size. For the first term, we define 

n 

(A.2) U^^n{e,Qn{e)):=Y.r^k{dk{0)-dk{9k{9)))[D,k{e)r^ 

k=m 

and we will use a property of submartingales (Theorem 2.1 in [9]; see also 
Theorem A.l) that leads to 



XP[ max SUJ)\Um,n{d,Gn{d))\> ^ 
\n:m,<n<m' a 

(A.S) - - 

,m' (^) Grn' 
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Then, using LIPg({dk{9)}) and the sufficiently rapid convergence of the mesh 
size to 0, we wih prove that limmhnim/ E{supg \ Um,m'i9,Qm'{0))\) = 0, from 

which we will deduce that lim^ sup„>^ supg \Um,niG , GniG))\ = 0, thanks to 

(A. 3), and then limm lim„>m supg|C/m,n(^5 ^n(^))| = 0. Finally, the result 
will follow from the relationship, due to Lemma A. 3, 



\Ln{9,gnm\[D,niO)Y 



n 
k=l 



together with a generalized Toeplitz lemma applied to the supg of this quan- 
tity. 

We now provide details of the proof. We define, for each k, a discretization 
of by a random grid Gk with fixed directions, a fixed origin and a random 
mesh size e^, J-fc_i-measurable and converging a.s. to sufficiently rapidly 
as A; — )• oo according to the assumptions A\ and A| defined later in the proof. 
Let {Ok^i}i =: 6fc be the vertices of Gk H Q and let, for 6 £ @, 9k{d) G &k be 

one of the elements of 0^ closest to 6, that is, 116*^(0) — 6*11 < cefc, where c is 
any constant satisfying c > where || • || is the Euclidean norm. 

Let us first consider the second term of the right-hand side of (A.l). 
Defining := ELl[4(^fc(^))]^ ^*n(a„(^)) := ELiKfe(^fc(^))]'> 

we have 

\Ln{gn{0))\ 



sup ■ 



(A.4) 



< sup 



(0) 

Ln{Gnm\ 



sup ■ 



+ 1 



Since, for k <n, 0^(0) is J^yfc_i-measurable and {Gn{G)}0 is a finite set, we 
get, as in the finite case, 

limsup '^"f;^fj.)' -=^-0 

Moreover, thanks to LIPg({d^fc(0)}), there exists J-fc„i-measurable, and 
such that \d,k{e) - d,k{Okie))\ < KiWOkie) - ek\\)g,k, implying that 



on <^ liminf L)*„(^„(6')) ■^=' CO >. 
I n e ) 



(A.6) 



sup ■ 



1.(^)1 ^ Y^^=l^*kg*kUk{£*k) 



where e^k ■= K{cek) and u{e^.k) = 2maxj \d^k{6k,i)\ + £*kg*k- 

Let < a < 1 and let us choose {e^] such that A\ :e^,kg*k'Uk{£*k) < of^ for 
all k. Therefore, the limit in n of (A.6) is a.s. finite. Then, also using (A.4) 
and (A.S), we get 

\\msuv\Ln{Gn{0))\[D,n{0)r^"=Q oii |liminfi?,„(g„(0)) =-oo|. 
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Moreover, lim„ infe ^= oo is equivalent to liuininie D^,n{^) ^= oo 

under A\ because 

liminfL',„(0) <lim inf |D,„(6') - L',„(g„(6'))| + liminf 



< V'e*fc5'*fc'"fc(e*fc) + liminf i:'*„(^„(6')) 

^ — ' n 

k=l 

and lim„inf6iL'*„(^„(6')) < Ylk=i^*kg*kkuk{e^:k) + lim.„ inf^ -D*„(6'). 

Next, we show that hm.„ snY)Q\Ln{0 ,Qn{0))\[D^n{Q)\~^ ^= 0. Let us write 

{dk{e) - dk{ek{e)))[D,k{9)]-^ =■. dk{9M0))- 

Since {r]k} is a martingale difference sequence and dk[0), 6k{9) and 0/^(9) 
are J-fe_i-measurable, it follows that {Um.^n{S ,Gn{S))}n, defined as in (A. 2), 
is a martingale: 

Um,n-l{0,Gn-l{B)) = E{Um,n{9,Gn{9))\Tn-l). 

According to Jensen's inequality, this implies that {supg |C/m,n(^5 ^n(^))|}n 
is a submartingale: 

Snp\Ura,n-l{9,gn-l{e))\ < ^ (sup| ?7„,,„ 1 1 . 

Therefore, using Theorem 2.1 ([9]; see also Theorem A.l) and denoting by 
Vm,n the quantity supg\Um,n{d,gniO))\, we get, for any A > 0, 

(A.7) XP( max V;n,n > a) < E(y^,„0- 

\n:m<n<m' / 

Now, using Vra,„i' ■= sup0\J2k'=m^kdk{d,dki6))\ and LIPg{{dk{9)}), which 
implies that \dk{9,9k{9))\ < efcfi'A;[^*fc(^)]~^i where is J"fc_i-measurable 
and Ek = h{cek), we get 

(m/ 
^E{\7]k\ekgk [mfD,k{9) 
k=m / 

Using Holder's inequality and the J^fc_i-measurability of e^, gk, [infg D^kiG)]~^, 
we get 

ffce/cS'fe inf-D*A,.(^) 

\k=m / 

Let us choose {e^} such that it satisfies : efc(Tfc(7fc[inf0 < a , for 

all k, in addition to A\. Then E{Vm,m') < YlT=Tn^'^ i™ply™g) accord- 

ing to (A.7), that 

oo 

k 



-1 



(A.8) limAPf max Kj,n, >A)<V 



a 

k=m 
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Consequently, since Xlfc^m'^'^ < (^-8) implies that 



(A. 9) limlimP max Ki,™ > A = 0. 

■m m' \n : m<n<m' ' J 

Moreover, since {max„. ,m<n<m' > ^}rn' is an increasing sequence of 
events, it follows that P(sup„. m<„ Kn,.„ > A) = linim' P{maxm<n<m' ym,n > 
A). Therefore, (A. 9) becomes lim^ -P(sup„>„ 14i,n > A) = for all A > 0, 

which means that lim^ sup„>„ = 0. Therefore, there is a subsequence 
{sup„>^^ Vmi,n\mi that Converges a.s. to as mi — )• oo. However, for m> mi 

with m<n, Um,nid,Gn{d)) = Um„nid,Gn{0)) - Umi,m-lid,Gm-l{d)), which 

implies that sup„>^T4i,n < 2sup„>„. Vmi,n and, consequently, 
(A. 10) lim sup Vm n = which implies that lim lim Vm n 0. 

™ n>m ' ™ n>m ' 

It then remains to deduce from (A. 10) that lim„supgL„(^,^n(^))[-D*n(^)]^"'^ 
=■ 0. Let us write Sk for Ei=i mdi{e,ei{9)) := Ui,k-i{0,Gk-i{e)). Then 



Ln{e,gn{e)) = Y.^Sk+i-Sk)D,k{e). 

k=l 

Using Lemma A.S and D^k{G) — D^k-i{(^) = [c^*fc(^)]^i we get 

n n 
k=l k=l 

implying that 

|L„(g,g„(g))| ^ — — D^NjO) 
lim sup — — 7— < lim lim sup Vh n hm lim sup — - — 7-- 

n e D^n{0) N n>Nk<N ' ^ ri>N g D^n{0) 

(A.ll) 

+ lim lim sup Vk n- 

Now, using, in the first term of the right-hand of side of (A.ll), Uk^ni^, Qn{Q)) - 
Uk,N-i{0,QN-i{0)) + UN,n{0,Qn{0)), and, in the second term, Uk,n{0,Qn{0)) = 
UnA^MO)) - UN,k-ii0,Gk-iiO)), thanks to (A.IO), we get (5.1). □ 

Lemma A.l (Wu's lemma [34]). // for all 6 > sufficiently small, 

a.s. (P) ^ as (P) 

lim„inf(jeB^(5„(6') - 5„(6'o)) > , then liuin 9^ '= Oq. 

Theorem A.l (Theorem 2.1 in [9]). // {Si,Tul < i < n} is a 
suhmartingale, then, for each real \, we have AP(maxj<n Si > \) < 

^(5'nl{max,<„5,>A})- 
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Lemma A. 2 [16]. Let > for all k, with ai > 0, and Sn = Yl^=i'^k 
with lim„ 5„ < oo. Then YlT=i ^kS^"^ < 20^"^ — lim„ . 

Lemma A. 3. Let {Sk} with Si = 0, Dk = Ef=i d^i- Then YJLi^Sk+i - 
Sk)Dk = Y^k=ii^n+i — Sk)d\. 

Proof. Y.l=i{Sk+i-Sk)Dk = Sn+iDn+Y.lZ\Sk+iDk-Y.l=iSkDk = 
Sn+iDn + ELi Sk{Dk-i - Dk). Then use Dk - Dk^i = dl □ 
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